Anatomy of a Data Stream Management System

In this paper, we identify issues and present solutions developed – both theoretical and experimental – during the course of developing a data stream management system (DSMS) for applications in a sensor environment. Specifically, we summarize our solutions for CQ processing, trigger mechanisms, and Quality of Service (QoS) management in a stream data processing system. Specifically, we first present our query processing model and then discuss our scheduling strategies to support different requirements of stream applications. We further discuss our QoS framework in such a DSMS and present our load shedding techniques, queueing model, and analysis techniques in order to effectively deliver QoS requirements for those applications. Finally, we discuss our integration model to enhance the active capability of a DSMS.